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> World Lighting 

• Radiosity Normal Mapping 

• Specular Lighting 

> Model lighting 

• Irradiance Volume 

• Half-Lambert 

• Phong terms 

> High Dynamic Range Rendering 


• Tone mapping 

• Autoexposure 
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Timeline 


> Half-Life 2 and Counter-Strike: Source (November 2004) 

• Baseline shading model we'll present today 

> Lost Coast (October 2005) 

• High Dynamic Range Rendering 

> Day of Defeat: Source (September 2005) 

• Color Correction and HDR 

> Half-Life 2: Episode One (June 2006 ) 


• Phong shading 
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Episodic Content Incremental Technology 


> The extensions to the baseline Half-Life 2 technology 
have been shipped in subsequent products in the 
year and a half since HL2 shipped. 

• More efficient way to develop technology 

• Delivers value to customers and licensees 


> Shorten the delay between hardware availability and 
game support 
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Marketplace Context 


r Cards which default to DirectX 9 Shader Model 3 Path on Source [142297 of 542600 Total Users [26.23% of Total) ) 

NVIDIA GeForce 6600 Series 

60,938 

42.82 % 

lllllllllllllllllllllllllllllllllllllllllll 

NVIDIA GeForce 6S00 Series 

36,447 

25.61 % 

llllllllllllllllllllllllll 

NVIDIA GeForce 7S00 Series 

22,057 

15.50 % 

llllllllllllllll 

NVIDIA GeForce 6200 Series 

10,374 

7.29 % 

lllllll 


1,578 

1.11 % 

1 


1,563 

1.10 % 

1 

NVIDIA GeForce 6610 XL 

1,380 

0.97 % 

1 

NVIDIA GeForce Go 6800 

1,235 

0.87 % 

1 


1,216 

0.85 % 

1 


1,122 

0.79 % 

1 

NVIDIA GeForce 6100 

1,000 

0.70 “/□ 

1 

NVIDIA GeForce 6700 XL 

800 

0.56 % 

1 

Other 

2,587 

1.82 % 

II 

j 


1 Cards which default to DirectX 9 Shader Model 2 Path on Source [178964 of 542600 Total Users [32.98% of Total) ) 1 


43,746 

24.44 % 

llllllllllllllllllllllll 


33,876 

18.93 % 

lllllllllllllllllll 


31,332 

17.51 % 

llllllllllllllllll 


12,417 

6.94 % 

lllllll 


10,875 

6.08 % 

mill 


10,492 

5.86 % 

mm 


9,180 

5.13 % 

mil 


7,206 

4.03 % 

mi 


4,945 

2.76 % 

III 


4,451 

2.49 % 

II 


4,039 

2.26 % 

II 

Other 

k_ 

6,405 

3.58 % 

mi 
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Sir http://www.steampowered.com/status/survey.html 
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World Lighting with Radiosity 


> Realism 

> More forgiving than direct lighting only 

• Avoids harsh lighting situations 

• Less micro-management of light sources for content 
production 

• Can't tune lights shot-by-shot like movies. Don't 


know what the shots are, and don't want to take the 
production time to do this 
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Direct lighting oniy 
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Radiosity lighting 
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> Reusable high-frequency detail 

> Higher detail than we can currently get from 
triangles 

> Works well with both diffuse and specular 


lighting models 

> Can now be made to integrate with radiosity 
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Radiosity Normal Mapping 


> We created this technique to efficiently address the 
strengths of both radiosity and normal mapping 

> In other engines, per-pixel lighting terms are often 
accumulated one light at a time 

• Multiple lights handled by summing multiple light contributions 
within or between passes 

> We express the full lighting environment in our novel 
basis in order to effectively perform diffuse bump 
mapping with respect to an arbitrary number of lights 

> This is the key to shading in Valve's Source engine 
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Basis for Radiosity Normal Mapping 
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Computing Light map Values 



> Traditionally, when computing light map values using a 
radiosity preprocessor, a single color value is calculated 

> In Radiosity Normal Mapping, compute light values for 
each vector in our basis 


• This triples light map storage, but we are willing to bear this cost 
for the added quality and flexibility 
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> Sample three light map colors, and blend between them 
based on the transformed vector 

floats dp; 

dp.x = s"turat^ ( dot( normal, bumpBasis[0] ) ); 

dp.y = saturate ( dot( normal, bumpBasis[l] ) ); 

dp.z = saturate ( normal, bumpBasis[2] ) ); 

dp *= dp; 

diffuseLighting = dp.x * lightmapColorl + 

dp.y * lightmapColor2 + 
dp.z * lightmapColorS; 
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Light Maps Only 
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Variable Luxel Density 


Coarser light maps used 
in low frequency areas 
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High density typically 
4"x4" luxels 
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Final Rendered Scene 












World Specular Lighting 


> We use cube maps for specular lighting the worid 

> Designers piace the sample locations for specular lighting 

> Cube maps are pre-computed in-engine from the level 
data using rendering 

• Especially interesting for HDR, which we'll discuss later 

> World surfaces pick up the "best" cube map, or cube 


maps can be manually assigned to surfaces to fix 
boundary problems 
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||| File Edit Map View Tools Window Help 


- S X 



Textures 


T exture group: 

I All Textures 

Current texture: 

I brick/brickfloor001 a 

512x512 

Browse... I 


Environment probes 
placed in Level Editor 


e Si % io & cv <3 ite e wiiTi fnrrrS" s-'l® 




% 






For Help, press FI 


|2 objects selected. 


I 82w 1 6321 348h @(-4833 560 430) f 


I Snap: On Grid: 16 
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Specular on World Geometry 
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Specular from cube maps 
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other World Lighting 
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Model Lighting 


> Prior to Episode One, models (objects which aren't 
part of the immovabie geometry) used 
primarily view-independent lighting terms: 

• Two local diffuse lights with Half-Lambert 

• Directional ambient term (ambient cube) 

> Also cubic environment mapping terms 


> These terms maxed out ps_2_0, which was our high 
end when we shipped Half-Life 2 in November 2004 
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> Typically clamp 


terminator 


> Half Lambert 


cosine term (red 


squares 


around (blue 


Another 


example of choosing 


forgiving lighting model 


Similar to Exaggerated Shading 


apaper by Rusinkiewicz et al 
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> Quake III used a filtered sample 
from a 3D array of ambient terms to 
provide a constant ambient for a 
given character [Hook99] 

> MotoGP used a hemisphere lighting 
model where bounced light from the 
ground varied spatially throughout 
the race track [HargreavesOB] 

> Max Payne 2 stored linear 4-term 
spherical harmonic coefficients for 
use in lighting characters and other 
moving geometry [Lehtinen06] 



From [HargreavesOB] 
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Ambient Cube 


> Pre-compute irradiance samples 
throughout the environment 

> 4'x4'x8' density 

> The set of samples is referred to in 
the literature as an irradiance 
voiume [Greger98] and each 
sample defines an irradiance 
environment map [RamamoorthiOl] 

> Directional ambient term which includes indirect light 

> Lights beyond the first two can be added to the ambient cube 



Directional Ambient 


Constant Ambient 
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Ambient Cube Basis 


> Six RGB lobes stored in shader constants 

> More concise basis than first two orders of spherical 
harmonics (nine RGB colors) 

> Pixel shader constant store is currently a bottleneck, 
though this eases quite a bit on ps_3_0 

> Developed in parallel with other techniques such as 
[RamamoorthiOl] 


floats AmbientLight( const floats worldNormal ) 

{ 

floats nSquared = worldNormal * worldNormal; 
intS isNegative = ( worldNormal < 0.0 ); 
floats linearColor; 

linearColor = nSquared.x * cAmbientCube[isNegative.x] + 

nSquared.y * cAmbientCube[isNegative.y+2] + 
nSquared.z * cAmbientCube[isNegative.z+4]; 
return linearColor; 

} _ 
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Original Light Probes 


[RamamoorthiOl] 


Valve Ambient 
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Benefits of Half Lambert and Ambient Cube 

















Benefits of Half Lambert and Ambient Cube 
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Extensions to Earlier Model Lighting 
















> When \ 

/ve shipped Half-Life 2, 

ps_; 

2_0 

1 was 

the most 


advanced pixel shader model available 

> In the spring of 2006, 40% of our users have hardware 

which supports ps_2_b or higher 

• Of the people who have played Episode One in the two 
months since it has shipped, 62 ®/o have such hardware 


> For Episode (9/7eand a recent update to Day of Defeat: 
Source, we used these longer ps_2_b shaders to add 
Phong terms to model lighting 
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> Shader model on ATI RADEON XxOO parts 

> Same programming model as ps_2_0 but with ionger 
shaders 

• ps_2_0 - 64 alu and 32 texture 

• ps_2_b - 512 total...any mix of alu and texture 

> ATI RADEON XxOO & XlxOO series 
NVIDIA GeForce 6x00 & 7x000 series 
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Phong Terms 


> Compute Phong terms 
for up to two local lights 

> Can specify specular 
exponent variations 
across a model 

• Currently, map blends 
between specular 
exponent of 1 and 150 

> Modulate with scalar 
mask channel and 
tweakable Fresnel term 



SpecularExponent 
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Episodic Alyx Shade Tree 
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Diffuse Lighting used in 
Half-Life 2 
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High Dynamic Range 


> A High Dynamic Range image is an image that has a 
greater contrast range than can be shown on a 
standard display device, or that can be captured with 
a standard camera with just a single exposure 

> High Dynamic Range rendering performs 
intermediate operations such as shading in high 
dynamic range space 


> The rendered HDR results are then mapped to a 
limited-range display 
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Tonemap scale 


Tonemap scale = 0.05 


Tonemap scale = 1 
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Scene from Lost Coast aX. Multiple Exposures 
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Authored Sources of HDR Illumination 


> HDR sky box authored by painting multiple exposures 
of the sky 

• start with seamless LDR sky texture and paint HDR 
information from there 

• We use a combination of Photoshop and HDRShop to make 
edits / touchups at different exposure levels 

• The industry has not addressed this issue adequately at this 
point and there is an opportunity for a tool vendor to step up 
and fix this 

> Local lights with HDR values placed in levels 

© 2007 Valve Corporation. All Rights Reserved. SIGGRAPH2006 


Generated Sources of HDR Illumination 


> HDR light maps are generated offline using our 
radiosity solver and stored in RGBE format. At run 
time, these are stored in a 16bit per channel format 

> HDR Cube maps are generated by the engine using 
the HDR skybox as well as the HDR light sources and 
the HDR light maps 

• The result is that an object which reflecting the sun or some 
other bright part of the scene, you will see this in the full 
effect of the brightness in the reflection, which is one of the 
key advantages of HDR rendering 

o 
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HDR water reflection and refraction 
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> Very careful with linear versus gamma color spaces 

> All shaders in our DirectX 9 code path are single-pass 

> As a result, tone mapping can be performed during 
normal rendering 

• Simple subroutine added to the end of all pixel shaders 

> This allows us to use 32-bit RGBA render targets 

• No increase in render target memory footprint 

• MSAA supported 

• 60% of our total users see HDR rendering 


• 82% of those who have played Episode One so far! 
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> Running luminance histogram of post-tonemapped frame 

• Update one bucket per frame 

• More histogram buckets for low luminance values 

> Each frame, we determine which output pixels fall within a 
given range, tagging such pixels in the stencil buffer 

> Use an asynchronous occlusion query to count pixels in range 

> Full running histogram (not just a single average luminance) is 
available to the CPU with no stalls 

> Time averaging is used smooth out auto exposure adjustments 

> Designers can also modify auto exposure and bloom across 
different areas of a level or in connection with game events 
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A single bucket from the running histogram (shown in red) 
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Anotflier bucket from the running histogram (shown in red) 
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Implemented Multiple HDR Paths 


> Floating point 

• HDR textures and render targets are fpl6 

• Shipped this path, but it is not the one typically used 

> Integer 

• Render to 32 bit RGBA integer frame buffer 

• Store HDR textures in fpl6 (linear color space) when filtered 
fpl6 textures are supported. 

• Store HDR textures in 4.12 linear color space otherwise. 

• Had to implement this version along with floating point 
version to support more hardware 

O 
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Float vs. Integer HDR Tradeoffs 


> Floating Point 

+ Pre-tone-mapping data available for blooming 
+ General refraction mapping techniques preserve HDR information 

- Requires floating-point alpha blending 

- Hardware lacks precision to perform fixed function pixel fog 

> Integer 

-F Compatible with Multisample Antialiasing (MSAA) 

+ Works on all DirectX 9 hardware (runs well even on ATI RADEON 9600) 

-F Small performance hit relative to LDR 
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Team Fortress 2: NP 
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Team Fortress 2: NPR^ 
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> Color has been used in visual arts to evoke particular emotional 
responses for millennia, and we can do the same in video games 

> It is very natural to apply color correction to rendered images as a 
post process, since we're doing lots of image processing already 

• Simply define a mapping from a one set of RGB triples to another 

• We do this with a 32^ volume texture lookup (sometimes several) 

> Decouples color correction from the art or lighting of a given setting 

> Useful for a variety of purposes 

• Stylization 

• Day for night 

• Gameplay 

o 
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Color Correction in Source 


> Color correction in games can go beyond what is 
possible in film 

> The dynamic nature of games is both a curse and a 
blessing 

• More difficult to tweak to specific scenes 

• Far more potential to exploit the dynamic nature of games 

• Strong feedback loops with the player 

• Additional sideband communication with the player 

> Color correction is a powerful tool for art direction 

• Mod authors and licensees can differentiate their titles 
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Desaturation 
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Future Directions 



> Improvements to 
irradiance volume 
sampling 

> Shadow Mapping 

> Foliage Rendering 

> Soft Particles 

> Non-Photorealistic 
rendering in Team 
Fortress 2 


% 
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> World Lighting 

• Radiosity Normal Mapping 

• Specular Lighting 

> Model lighting 

• Irradiance Volume 

• Half-Lambert 

• Phong terms 

> High Dynamic Range Rendering 
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Autoexposure 
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Color Correction 
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> Publicly available SDK 

> Academic licenses provide 

• Access to Valve games 

• Source code 

• HLSL shaders, Radiosity and visibility calculations 

• AI system, path finding 

• Animation system, acting system, inverse kinematics 

• Production quality art and sound assets 

• Useful level and modeling tools 

• Hammer level editor, Faceposer, Model viewing utilities 


academiclicensing@valvesoftware.com 
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> Many thanks to Gary McTaggart, Chris Green, 

James Grieve, Brian Jacobson, Ken Birdwell, 

Bay Raitt and the rest of the folks at Valve who 
contributed to this material and the 
engineering behind it 

> Thanks also to Paul Debevec for the light 
probes used in the comparison with 
Ramamoorthi's Irradiance Environment Maps 

O 
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